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> ! Abstract 



An integral operator M is constructed performing a separation of variables for the 



O ! 3-particle quantum Calogero-Sutherland (CS) model. Under the action of M the 
CS eigenfunctions (Jack polynomials for the root system A2) are transformed to the 
ijT) ■ factorized form (p{yi)(p{y2), where ip{y) is a trigonometric polynomial of one variable 
^ . expressed in terms of the 3F2 hypergeometric series. The inversion of M produces 
a new integral representation for the A2 Jack polynomials. 



S '. 1 Quantum Calogero-Sutherland model 



Define N differential operators {Hk}^=i, acting on functions of N variables q = 
{gi, . . . , gAr} and depending on a parameter g, by the formula ^ 

where 

Dm,n = u{qi - q2)u{q3 -qi) ... u(g2m-i - q2m)^ ^ ^ • (2) 

Oq2m+l<jq2m+2 • • • Oq2m+n 

Here we denote u{q) = —g{g — 1)/ sin^ q, whereas ©at is the permutation group 
of the set {1, . . . , N}, and G{m, n) = {a E &n\D^^^ = Dm,n}- 

^On leave from Department of Mathematical and Computational Physics, Institute of Physics, 
St. Petersburg University, St. Petersburg 198904, Russia. 

^On leave from Steklov Mathematical Institute, Fontanka 27, St. Petersburg 191011, Russia. 
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Note that, when (7 — 0, the operators Hk behave as 

providing thus a one-parameter deformation of the elementary symmetric polyno- 
mials in d/dqj. 

It is known [|^ that the operators Hk generate a commutative ring which contains, 
in particular, the quantum Calogero-Sutherland |0, ^, ^, |^ Hamiltonian 

To describe the quantum problem more precisely, define the space of quan- 
tum states Ti.^^^ as the complex Hilbert space of functions on the torus T*^^^ = 
M^/ttZ^ 3 q which are symmetric w.r.t. the permutations of qj, the scalar product 
being defined as 

$) = rdq, . . . rdq^ ^iq)Hq). (5) 
Jo Jo 

Note that for the real g the operators (|I]) are formally Hermitian w.r.t. the above 
sesquilinear form. Let the vacuum (ground state) function Q be defined as 



j<k 



(6) 



Though Q e H(^) for g > — |, we shall assume a more strong condition g > 
which simplifies description of the eigenvectors. Let T^^^ be the space of symmetric 
trigonometric polynomials in variables q, that is the symmetric Laurent polynomials 
in variables tj = e^**. The simplest way to fix the "boundary conditions" for the 
operators Hk is to restrict them first on the dense linear subset D^^^ = ilT^^^ C 
1-L^^\ Since V'^^^ consists of common analytical vectors of operators Hk-, the latter 
can be extended uniquely to commuting self-adjoint operators in 7i*^^\ 

The complete set of orthogonal eigenvectors to the self-adjoint Hk 

Hk^n = hk-^n (7) 

is well known p, |^. The eigenvectors are parametrized by the sequences n = {ni < 
n2 < . . . < un} oi integers rij G Z. The corresponding eigenvalues hk are 

hk = 2'' ■ ■ ■ =nj + g (j - • (8) 



n<-<3k 

The eigenfunctions allow the factorization 

*n(g1 = mUo), Jn e r(^). (9) 

In particular, for the ground state Q = ^^c.g and J0...0 = 1- The symmetric 
trigonometric polynomials Jn are known as Jack polynomials corresponding to the 
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root system A^-i or simple Lie algebra sIn, see and also 0] for the A2 case. 
Our notation differs slightly from the conventional one: our parameter g relates to 
a used in [|| as (7 = a^^, and we do not impose the restriction rij > 0. 

The problem of finding square integrable eigenfunctions ^ G H^^^ of the opera- 
tors Hk turns out thus to be equivalent to the purely algebraic problem of finding 
the polynomial eigenfunctions J E T^^^ of the differential operators Hk obtained by 
conjugation of with Q 

Hk = n-^Hkn. (10) 

Jack polynomials can be considered as a one-parametric deformation of elemen- 
tary symmetric polynomials Sfi{q) = J^^i^ ■ ■ ■t'l^ where the sum is taken over all 
distinct permutations z7 of n, such that 

Jfi = Sfi -\- hififiiSfii, (11) 

where k^^/ is a rational function in g vanishing for (7 = 0, and the dominant order 
for sequences n is defined as 

{N N N N 1 

T.^3=T.^'r E^i>E^;' fc = 2,...,iV (12) 
j=l j=l j=k j=k ) 

Another important property of Jack polynomials is the orthogonality with the 
weight 

/"IT rn _ 

/ dqi... dqN JH{q)Jn'{q)^^{q) =0, n ^ n' (13) 
Jo Jo 

For the generalization of Jack polynomials for other root systems see [Q. 



2 Separation of variables: conjectures 

In the classical case, when the differentiation —id/dqj is replaced by the momen- 
tum pj canonically conjugated to qj, the Calogero- Sutherland system is completely 
integrable in the Liouville's sense 0, |]. It is thus natural to speak of its quantum 
version described above as a quantum integrable system. The common property to 
be expected from an integrable system (classical or quantum one) is the separability 
of variables j^, |TD|, [TT], |T2| which suggests the following conjecture. 
Conjecture 1. There exists a linear operator 

K ■.^Hiq}^^niyi,...,yN^i;Q) (14) 

such that any eigenfunction \E'^ is transformed into the factorized function 

N-l 

^riiyi,...,yN-uQ) = e'''''^ UMyk). (15) 

k=l 

The distinguished variable Q = qN is simply the coordinate canonically conju- 
gated to the total momentum Hi. 
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The study of the low-dimensional cases = 2, 3 allows to formulate an even 
more detailed conjecture about the structure of the separated eigenfunction 
Conjecture 2. The factor ip^tly) in (|7^ allows further factorization 

^„Kl/) = (siny)(^-i)Vn(y) (16) 

where ^n{y) is a Laurent polynomial in t = e^*^ 

Vfihj) = J2 t^Ckin;g). (17) 

k=ni 

The coefficients Ck{n;g) are rational functions of k, uj and g. Moreover, f^niy) 
can he expressed explicitely in terms of the hypergeometric function n^n-i as 

^n{y) = - ty-'^'MFN-iiau ...,aN]bu..., bN-i, t) (18) 

where 

aj = ni- n^-j+i + I - {N - j + l)g, bj = aj + g, (19) 

N^N-l[ai, . . . , Cat; Oi, . . . , On^i, t) — jj-r 77 r— TT, [ZO) 

fc=0 \^^)k ■ ■ ■ [ON-ljk'^- 

and (a)fc is the standard Pochhammer symbol: 

(a)o = l, (a)fc = a{a+l)...{a + k-l) = ^ ^^^^^ • (21) 

The conjectures 1 and 2 are proved in the next section for the N = 2 case 
and in the sections ^ and |^ for the = 3 case. Section ^ contains also a more 
detailed discussion of the conjecture 2 for > 3, see theorem ^. Further support 
to the conjectures is given by the study of the case g = 1 when Jack polynomials 
degenerate into Schur functions (section [Zp. 



3 Ai case 

It is a well known fact that in the Ai case Jack polynomials are reduced to hyper- 
geometric polynomials of one variable [§. Nevertheless, we review the derivation 
briefly in order to prepare the stage for the discussion of the A2 case. 
For N = 2 the commuting operators (|I]) are 

Hi = -z{di + 82), H2 = -8182 - g{g - 1) sin-2gi2. (22) 

(we denote 8j = 8/8qj and qjk = qj — qu)- Respectively, 

Hi = -i{8i + 82), H2 = -8182 + g cot qi2{8i - 82) - 

the vacuum vector being 

fi(g) = IsingiaT (23) 
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The eigenvectors resp. Ja, according to are parametrized by the pairs of 
integers n = {ni < ^2}, the corresponding eigenvalues being 



hi = 2{mi + 1112) = 2{ni + ^2) 
where 

mi 



/i2 = 4mim2 = {2ni - g){2n2 + 



9 , 9 

111 - -, m2 = ^2 + 



2 ^ ^ 2 

The separation of variables is given by the simple change of coordinates 



(24) 
(25) 



K : ^{qi, q^) ^ ^{y, Q) = vl>(y + Q,Q). (26) 

Actually, the calculations would be simpler for the more symmetric definition 
Q = (Q'i + '?2)/2 rather than Q = q2 but we wish to preserve here the coherence of 
notation for the study of iV = 3 case. 

The spectral problem = hk"^ rewritten in terms of the function reads 

9(9-1 



[dq - ihi] * = 0, 



d. 



sin^ y 



* = 0, 



allowing immediate separation of variables of the form (|T5D 

^{y,Q) = e''^^ij{y), 
the function satisfying the second order differential equation 



9(9 



sin^ y 



ij = o 



which, via the transformation ipiv) = sin^ ?/</)(?/), can be rewritten as 



dy + {2g cot y — ihi)dy — {g^ + ighi cot y + /i2) = 0. 



(27) 



(28) 



(29) 



(30) 



The last equation, after the substitution t = e^*^, is reduced to the standard 
Fuchsian form 



g-l + ihi_^ 2g 



t 



t-1 



dt + 



lig^ + ghi + h2) \ghi 



(^ = 0. (31) 



tit -I) 

The equation ( |3TD has 3 regular singularities: {0, 1, 00} with the characteristic 
exponents: 

t~l i^^{t-lY /i €{-2^ + 1,0} 
t~0 ip f P^{ni,n2 + g} 

t ~ 00 ~ t^" —o G {^1 — (7, n2\ 

Moreover, by the substitution ^pit) = t^^{\ — tY^'^^fit) the equation ( pi] ) is re- 
duced to the standard hypergeometric equation 

[tdtitdt + 61 - 1) - t{tdt + ai){tdt + aa)] / = 0, (32) 

the parameters ai, 02, hi being given by the formulas (|T9|) which for N = 2 read 

ai= ni-n2 + l - 2g, a2 = I - g, bi = rii - n2 + I - g. (33) 

From J„i„2 £ ^''^^ it follows immediately that the corresponding (y9„j„2(^) is a 
Laurent polynomial in t. 
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Proposition 1 The Laurent polynomial <y9„j„2(t) is given, up to a constant factor, 
by the formula ( |7^ j which, for N = 2 takes the form 

<^nin,(t) =t""(l-t)'-'^Fi(ai,a2;6i;t) (34) 

the parameters ai, 02, &i being given by (^^. 

Proof. Define the function F„^„2(t) by the right hand side of the formula ([3^). 
Strictly speaking, the hypergeometric series converges only for |t| < 1 but in few 
moments we shall see that F^^^^l^) continues analytically to the whole complex 
plane. Using the well known formula 

(1 -t)'^+^-'=2i^i(a,6; c;t) = 2^1(0 - a, c- 6; c;t) 

we can rewrite F„j„2('^) folllows 

Fn^n^it) = 2-^1(^1 - n2, g; ni - n2 + I - g]t) 

It is easy to observe now that the hypergeometric series in the right hand side 
terminates for integer {ni < n2} and -F„^„2 is thus a Laurent polynomial 

"2 
k=ni 

of the form ([T7|). Since -F„in2 satisfies the same differential equation (|3TD as ipnin2 and 
the linearly independent solution to ( ^l]) is obviously not polynomial, the functions 
Fnin2(t) and V9„^„2(^) are identical up to a constant factor, which finishes the proof 
of the proposition and of the conjectures 1 and 2 for = 2. ■ 

4 A2 case: Integral transform 

For = 3 the commuting differential operators (P read 

Hi = -t{di + d2 + d3), 

H2 = -{did2 + did^ + 8283) - g{g - 1) (sin^^ + sin-^ qi3 + sin'^ ^23) , 
H3 = {818283 + ig{g-l){sm~'^q23di + sm~'^qi3 82 + sm~'^qi2 83^ , 

and, respectively, 

£1 = -^{81+82 + 83) 

H2 = -{8182 + 8183 + ^293) 

g[coi qi2{8i - ^2) + cot gi3(9i - ^3) + cot g23(52 - <93)] 

H3 = 1818283 

-ig[coi qi2{8i - 82)83 + cot gi3(9i - 83)82 + cot 523(^2 - 53)^1] 

+2ig'^[{l + cot qi2 cot gi3)<9i + (1 - cot qi2 cot g23)<92 + (1 + cot qi3 cot 523)^^3] 
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the vacuum function being 



|sin gi2Sin gig sm gssi 



(35) 



The eigenvectors resp. J^j, according to (||), are parametrized by the triplets 
of integers {rii < n2 < n^} E 'Z^, the corresponding eigenvalues being 



hi = 2(mi + 1712 + ms), 
where, 



4(mim2 + mim^ + 17121713), = 8mim2ms, (36) 



mi = 111- g, 



1712 = n2, 



m3 = ns + g. 



(37) 



The structure of the operator K performing separation of variables in the A2 case 
is more complicated than in the Ai case. In contrast with the Ai case, K is given 
by an integral operator rather then by simple change of coordinates. To describe 
K, let us introduce the following notation. 

xi = qi- gs, X2 = q2- qs, Q = qs, 

x± = Xi±X2, y± = yi+y2. 

We shall study the action of K locally, assuming that qi > q2 > qz and hence 
a;+ > X-. 

The operator K : \&(gi, ^3) ^ ^(z/i, 2/2; Q) is defined as an integral operator 



with the kernel 



JC{yi,y2; 0^ + ^' ^ 



(3^ 



JC = K. 



sm I ^ j sin 



sm I ^^^) sin (^^^ 



sin yi sin 7/2 sin ^ 



(39) 



where k is a normalization coefficient to be fixed later. It is assumed in (p8| ) and 
([39| ) that y^<X- = S,<y+ = x+. The integral converges when g > Q which will 
always be assumed henceforth. 

The motivation for such a choice of K takes its origin from considering the 
problem in the classical limit {g —>■ 00) where there exists effective prescription for 
constructing a separation of variables for an integrable system from the poles of the 



so-called Baker- Akhiezer function. See ||T^, §7, for a detailed explanation. 



Theorem 1 Let Hk^nxn2nz = ^fc^nin2n3- Then the function \E'^ = K'^fi satisfies 
the differential equations 



where 



Q^^ = 0, 3^,^rJ = 0, J = 1,2 

Q = -idn - hi, 



(40) 
(41) 
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- k + ^^^^h + 2ig{g - l){g - 2)^^ ) . (42) 
V sm yj sm y^ ' 

The proof is based on the following proposition. 

Proposition 2 The kernel K satisfies the differential equations 

{-uJq - h;]k = 0, 



\ sm yj sm yj 

where H* is the Lagrange adjoint of Hn 



K = 0, 



^{q)m){q) dq = j {H*^){q)^l;{q) dq 

HI = -dq^dq^ - dq^dq^ - Oq^Oq^ - g{g ~ 1)[ sln'^ qi2 + sin~^ gi3 + sin"^ gss], 
= -idq^dq^dq^ - ig{g - l)[sin"2 gas dq^ + sin"^ gia dq^ + sin"^ qudq^]. 

The proof is given by a direct, though tedious calculation. 

To complete the proof of the theorem [1|, consider the expressions QK'^fi and 



yjK'^fi using the formulas (pSD and (|39D for K. The idea is to use the fact that \E'^ 
is an eigenfunction of and replace kk'^ft by Hk^a. After integration by parts in 
the variable ^ the operators are replaced by their adjoints HI and the result is 
zero by virtue of proposition ^ 

The caution is needed however when handling the limits of integration y± in 
([38|). The following argument allows to circumvent the problem of boundary terms. 
One can hide the limits of integration into the definition of the kernel /C considering 



the factors containing — y±) as the generalized functions similar to x^, see [|T3 
It is known that defined through the linear functional 



(/,a;+) = / dxf{x)xl 





is analytic in A on the complex plane excluding the poles x = —1, —2, . . . and can 
be differentiated just as usual power function d^x'^ = Ax^~^. Therefore, we can 
safely ignore the boundary of integral (|38|) while integrating by parts. The only 
possible obstacle may present the integer points g = 1,2,3 (no more, since we need 
to differentiate /C maximum 3 times) where the boundary may contribute delta- 
function terms. The direct calculation shows, however, that all such terms cancel. 
■ 

The following theorem validates the conjectures 1 and 2 for the A2 case. 
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Theorem 2 The function ^E'n^njns is factorized 



nxn2nz 



{yi,y2;Q) = e' '^1pmn2n,{yi)lpmn2n;{y2 



(43) 



according to j^Tdj). The separated function ipnin2n3{y 2) has the structure ^Tdj). 



Note that, by vhtue of the theorem the function ^fi{yi,y2]Q) satisfies an 
ordinary differential equation in each variable. Since Qf = is a first order differ- 
ential equation having a unique, up to a constant factor, solution f{Q) = e*'*^*^, the 
dependence on Q is factorized. However, the differential equations yjipivj) = are 
of third order and have three linearly independent solutions. To prove the theorem 
H one needs thus to study the ordinary differential equation 



id; + hid;-i[h2 + 3 



sin^ y 



- \h3+ .2.. ^1 + 2«^(^ - 1)(^ - 2) 



sm y 



sin^ y 



= 0. 



(44) 



and to select its special solution corresponding to ^. 

The proof will take several steps. First, let us eliminate from \E' and \^ the 
vacuum factors fl, see (0), and, respectively 



^(1/1, 1/2; Q) = t^(yi)t^(y2)^(l/i,Z/2;Q), uj{y) = sin^^y. 
Conjugating the operator K with the vacuum factors 

M = uj^^uj^^Kn : J v-^ J 
we obtain the integral operator 



J{yi,y2;Q) 
with the kernel 



dCM{yuy2; ( + Q, + Q,Q 



(45) 



(46) 



(47) 



M{yi,y2\0 = /C(?/i,?/2;0 



+ Q,'-^ + Q,Q 



K sin ^ 



^(2/1)^(2/2) 
9-1 



sin (^) sin (^)]' [sin (^) sin (^) 



2g-l 



[sm yi sm y2 



1 39-1 



(48) 



Proposition 3 Let S be a trigonometric polynomial in qj, i.e. Laurent polynomial 
in tj = e^*'^^ , which is symmetric w.r.t. the transpositon qi <-> ^2- Then S = MS is 
a trigonometric polynomial symmetric w.r.t. yi ^2/2- 
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Proof. It is more convenient to use variables x±, Q and, respectively, y±, Q. 
Since the kernel Ai does not depend on Q it is safe to omit the dependence on Q 
in S. The polynomiality and symmetry of S are expressed now as S = S{x+, x_) = 
Hk,nSkn€-^^^'"^ COS nx_ whcrc k^n are integers of the same parity, and ri > 0. 

From (^), (^) we obtain 

S{y+,y-) = K [sm — - sm —j X 

X / ax_ smx_ sm sm — sm sm — b[y+,X-]. 

Jv- \ 2 2 J \ 2 2 ) ' 



Let us make now the change of variables 

i± = sin^ dC,± = ^ sinx± dx±, r]± = sin^ (^9) 

denoting = S'(x+,x_). It is easy to see that S'(x+,^_) is polynomial in ^_ 

and that 

S{y+,y^) = 2k{^^ - T d^. {i^ - V-r\v+ " ^-)''-'S{y^,^^). (50) 
Now put 

and choose 

Then, finally 

S{y-,, y-) = f(^|f^ I' d^^^-'i^ - 0''~'S{y^, iv^ - V-)^ + V-)- (52) 



2B(g,2g) 2r(9)r(29) ' 



It is sufficient to calculate the integral ( [5^ ) for the monomials 

S = e"'y+rii{ri+-ri^rC 

such that k,l,m G Z, /,m > and k = I + m (mod 2). Evaluating the beta- 
function integral 



Jo 



T{3g + m) 



one obtains 

Sfe„._) = £MI(»±^lle--i(.. - (53) 

r(3^ + m)r(^) 

It is easy to verify that the result is a symmetric trigonometric polynomial in j/i, 

2/2- ■ 

Note that the normalization constant k is chosen in such a way that M : 1 i— >■ 1. 

The formula ( ^31) shows that the operator M can in fact be continued analytically 
in g on the whole complex plane excluding the points g = — 1,— |,... coming 
from the poles of the gamma functions in (^3|) and also (7 = — | , — | , . . . coming from 
the poles of T{3g) in the normalization constant k (0). 
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5 A2: Separated equation 

To complete the proof of the theorem ^ we need to learn more about the separated 
equation (|4^) . 

Eliminating from ip the vacuum factor u^y) = sin^^ y via the substitution ip{y) = 
ip{y)u!{y) one obtains 

idy + {hi + Gig cot y)dy 

+ {-i{h2 + 12/) + Aghi cot y + 3ig{3g - 1) sin"^ y)dy 

+ {-{h + 4:g^h) - 2ig{h2 + Ag^) cot y + g{?,g - l)hi sin'^ y)] = 0. (54) 

The change of variable t = e^*^ brings the last equation to the Fuchsian form: 

+ widl + W2dt + W3] = (55) 

where 

?>{g-l) + \hi 6g 
Wi = ■ h 



t t-1 

^Sg2_sg + i) + l{2g-l)hi + lh2 , 3(7(3(7-1) g{9{g-l) + 2h] 

W2 = ^ h 



t2 (t-iy t{t-i) 

^ g' + lg'hi + \gh2 + lh |(7((/^2 + V)(t-l)-(3(7-l)/ii) 

The points t = 0, 1, cxd are regular singularities with the exponents 

t~l ¥P~(t-l)^ /iG {-3^ + 2,-3^ + 1,0} 
t~0 p G {^1,^2 + 5',n3 + 251} 

t ~ CX3 ~ t^"" — cr G {rii — 2g, n2 — g, n^} 

Like in the A2 case, the equation (|55|) is reduced by the substitution ip{t) 
t"^(l — tY~^^f{t) to the standard 3F2 hypergeometric form |P 



[tat(t9t + 61 - l)(t9t + 62 - 1) - titdt + ai)(t9t + a2)(t5t + as)] / = 0, (56) 

the parameters ai, 02, 03, 61, 62 being given by the formulas ( ppj ) which for = 3 
read 

ai = m - 723 + 1 - 35f, a2 = rii - 722 + 1 - 2^1, 03 = 1 - 51, 
61 = ni - n3 + 1 - 25(, b2 = rii - n2 + I - g. 



Proposition 4 Lei t/ie parameters he given by (\3q), ( \3/i ) for a triplet of integers 
{rii < n2 < n-^} and g 1,0, —1, —2, .... Then the equation (j5^ has a unique, up 
to a constant factor, Laurent-polynomial solution 

Vit)= E t^'cui^n-g), (57) 

k=n\ 

the coefficients Ck{n;g) being rational functions ofk, Uj and g. 
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The above proposition follows from a more general statement. 



Theorem 3 Let the function -Fni,...,n]v(^) given for \t\ < 1 by the right hand side 
of the formula ([7^j, the parameters aj and bj being given by ( ff^ j for some sequence 
of integers n = {ni < n2 < ■ ■ ■ < un}. Let g 1,0, —1, —2, . . .. Then Ffi{t) is a 
Laurent polynomial 



n-N 



k=ni 



the coefficients Ck{n; g) being rational functions ofk, uj and g. 



Proof. Consider first the hypergeometric series for iv-F/v_i which converges 
for \t\ < 1. Using for aj and bj the expressions (|19]) one notes that a^+i = bj + 
riTv-j+i — and therefore 



{aj+i)k _ {bj + k)n 



N-i+i—riN-i 



The expression 

{0'2)k ■ ■ ■ iO'N)k (bi + k)nj^-nN_-^ ■ ■ ■ (^A^-l + fc)n2-ni 



(^l)fc • • • (&Af-l)fc (&l)n]v-njv_i • • • (&Af-l)n2-rai 

is thus a polynomial in k of degree — ni. So we have 



NFN-i{ai, . . . , Oat; bi, . . . , bN-i] ^) — E ^ u ^"■N-ni {k)t^ 

k=o 

from which it follows that 

NFN-iiai-, • • • , ^N] bi, ■ ■ ■ , &Af-i; t) = P„j^„„^(t)(l — t)^^ ^ 

where Pn^-ni{t) is a polynomial of degree n^- — rii in t. ■ 
To prove now the proposition ^ it is sufficient to notice that in the case = 3 the 
hypergeometric series 3^2(01, 02, as; 61, 62; i) satisfies the same equation ([56| ) as f{t) 
and therefore the Laurent polynomial Ffi{t) constructed above satisfies the equation 
(E^) . The uniqueness follows from the fact that all the linearly independent solutions 



to (^) are nonpolynomial which is seen from the characteristic exponents. ■ 
Now everything is ready to finish the proof of the theorem ^. Since the func- 
tion Jnin2nz{yi^y2]Q) satisfics (|5^) in variables yi^2 and is a Laurent polynomial it 
inevitably has the factorized form 

Jmn2n,{yi,y2]Q) = e'^^^(Pmn2n3{yi)'^n^n2n3{y2) (59) 

by virtue of the proposition H. H 
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6 Integral representation for Jack polynomials 



The formula (|59|) presents an interesting opportunity to construct a new integral 
representation of the Jack polynomial Jft in terms of the 3F2 hypergeometric poly- 
nomials ^n{y) constructed above. To achieve this goal, it is necessary to invert 
explicitely the operator M : J ^ J . 

Let us examine again the integral (0). Assume that x+ = ?/+ and respectively 
^+ = 7]^ are fixed whereas ?/„ are variables. Then, denoting 



2KT{g) 

we face the problem of inverting the integral transform 



FT^ 



(60) 



which is known as Riemann-Liouville integral of fractional order g [|15| . Its inversion 
is formally given by changing sign of g 



(61) 



and is called fractional differentiation operator. However, by our assumption g > 0, 
so the integrand becomes singular at ^_ = rj^ and the integral should be regularized 



in the standard way ||T3 
Retrac 

S{x+,x-) 



Retracing all the intermediate transformations we obtain 
T{2g) . . 



(r/--e-)-^-^(e+-77-)^^-^^(a:+,2/_) 



T{-g)Ti3g) J^^ 
and finally come to the formula for M^^ : J ^ J 

J{x+,x^;Q) = / dy-M{x+,X-]y-)J{x+,y-;Q) 

39-1 



M = k- 



sni y_ 



sin (^) sin (^) 



sm 



(^) 



sm 



where 



y--x- 



r(2^?) 



r . . 129-1 

smxi sma;2 



For ^ we have respectively 



K, = k- 



sm^ X- sm y. 



2Ti 



sm 



-g)T{H 

(^) sin (M.) 



(62) 
(63) 

(64) 



9-1 



sin sin ^ ^ ^ [sinxi sin 



-^2 



19-1 



(65) 



The formulas (^9]), (|62|) , (|63|) provide a new integral representation for Jack poly- 
nomial in terms of the 3F2 hypergeometric polynomials ^Pn{y)- The representation 
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would acquire more satisfactory form if one could describe explicitely the normal- 
ization of corresponding to the standard normalization ( pT]) of J. We intend to 
study this question in a subsequent paper. 

It is remarkable that for positive integer g the operators ^ become 
differential operators of order g. In particular, iox g = \ we have = d/dy^. 



7 Separation of variables in the Schur polynomi- 
als 



For the generic g the separation of variables in Jack polynomials is so far unknown 
for > 3. However, the problem simplifies drastically in the case g = 1, when 
Jack polynomials are reduced to the Schur polynomials 0, and allows quite simple 
solution. In the present section we have changed notation to make it more convenient 
for handling Schur polynomials. 
Let 



-Pni...niv(^l! • • • ! tN) — det 




l2 
l2 


,ni 

• ''Af 

• ''AT 


(66) 






jJlM 
l2 


.TIN 





Schur polynomial is defined as the ratio of two antisymmetric polynomials: 

Q /7\ _ Pni,n2+l,...,nN+N-l jt) 

^At) - - TTt • 

J^0,l,2,...,N-l[l^) 

Denominator (corresponding to Q in the previous sections) 

-Po,l,2,...,Af-H 



(67) 



lit) = Uitk-t,) 

k>j 

is the elementary antisymmetric polynomial (Vandermonde determinant). 
The separated equation 

N 

Y[{tdt-n,)ij{t) = 0. 



(6^ 



(69) 



has as the general solution the polynomial ip{t) = Y.j=i Cjf^^ ■ The boundary condi- 
tion 

= 0, A; = 0,l,...,A^-2 (70) 

t=i 

selects the solution 



c ■ ~ 



det 



1 


1 


1 


1 


nx 




rij+i . 


■ UN 


n\ 


• ^1-1 


^1+1 • 


■ n% 


N-2 
1 


N-2 

■ 


N-2 

• 


N-2 
■ ^N 



(71) 



k>l 
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In case of Schur polynomials it is easier to construct the inverse operator K ^ 
rather than K. Let 

Af-l 

^(tl, . . . , tN-l) = ^(tl) . . . ^(t7V-l) = n ^(^i) (72) 

i=i 

and 

= U {tk\ - t,dt^) . (73) 

k>j 

Theorem 4 The operator transforms the symmetric polynomial ^ into an 

antisymmetric polynomial "^{ti, . . . ,tN-i) = K'^"^ which is none other than the 
numerator of Schur polynomial 

VI/ . . . , ^) ^ p„^ . . . , t^). (74) 

The proof consists in an elementary calculation. 

Since we have already seen in the = 3 case that K^^ becomes a differential 
operator for integer > 0, it is not surprising that here K~'^ is also a differential 
operator. 

8 Discussion 

The construction of the operator M performing the separation of variables for Jack 
polynomials originates from mathematical physics (Inverse Scattering Method) and 
contains a lot of guesswork. A generalization of our results to the case of higher rank 
> 3 could probably throw some light on the algebraic and geometric meaning 
of the whole construction which remains still obscure. The only available results in 
this direction are so far the case g = 1 (Schur polynomials) and theorem ^ which 
allows to formulate conjecture 2 about the structure of separated polynomials in the 
general case. 

Among other challenging problems one should mention generalizations to other 
root systems, first of all BC^, and also to the g-finite-difference case (Macdonald 
polynomials) . 
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